Program  Progress  Report 
CDRL  A002 


Pilot-in-the-loop  Method  Development 


2012  Basic  and  Applied  Research  in  Sea-Based  Aviation 

ONR  #BAA12-SN-0028 


REPORT  No.  9/C576 

PERIOD  20  May  2014  to  20  June  2014 

Prepared  by 

Combustion  Research  and  Flow  Technology,  Inc.  (CRAFT  Tech) 
6210  Keller’s  Church  Rd. 

Pipersville,  PA  18947 

Phone:  215/766-1520;  Fax:  215/766-1524 

Attn:  J.  Shipman 

Email:  shipman@craft-tech.com 

20  June  2014 


Prepared  for 

Naval  Air  Warfare  Center  AD 
48110  Shaw  Road,  Code  4.3.2. 1 
Patuxent  River,  MD  20670 
Arlington,  VA  22203-1995 
Attn:  Dr.  Susan  Polsky,  Code  4.3.2. 1 
Phone:  301.342.8575 
Email:  susan.polsky@navy.mil 

Prepared  under 

Contract  Number:  N00014-13-C-0456 

PERIOD:  20  September  2013  to  20  September  2016 


DISTRIBUTION  STATEMENT  A:  Distribution  Approved  for  public  release;  distribution  is  unlimited. 


Report  Documentation  Page 

Form  Approved 

0MB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 

1.  REPORT  DATE 

SEP  2014  2.  REPORT  TYPE 

3.  DATES  COVERED 

20-05-2014  to  20-06-2014 

4.  TITLE  AND  SUBTITLE 

Pilot-in-the-loop  Method  Development 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Combustion  Research  and  Flow  Technology,  Inc.  (CRAFT  Tech), 6210 
Keller’s  Church  Rd.,Pipersville, PA, 18947 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

_ _ _  ABSTRACT 

18.  NUMBER  19a.  NAME  OF 

OF  PAGES  RESPONSIBLE  PERSON 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE  Same  aS 

unclassified  unclassified  unclassified  Report  (SAR) 

6 

Standard  Form  298  (Rev.  8-98} 

Prescribed  by  ANSI  Std  Z39-18 


Pilot-in-the-loop  Method  Development 

2012  Basic  and  Applied  Research  in  Sea-Based  Aviation 
_ ONR  #BAA12-SN-0028 _ 

PERIOD  20  May  2014  to  20  June  2014 

1  PROJECT  OVERVIEW 

The  goal  of  this  projeet  is  to  integrate  novel  numerieal  modeling  and  eomputer  hardware 
approaehes  to  eompute  the  non-linear  aerodynamie  eoupling  between  the  ship  and  aireraft  in 
sueh  a  way  that  exeeution  times  are  at  real-time  speeds,  allowing  for  pilot-in-the-loop  CFD  to 
be  integrated  in  the  piloted  flight  simulation  environment.  To  aehieve  the  speed  gains  required, 
three  areas  will  be  targeted  for  implementation  into  the  CFD  simulation  framework:  (1) 
numerieal  algorithms,  (2)  novel  domain  boundaries,  and  (3)  Graphieal  Proeessing  Unit  (GPU) 
hardware.  A  framework  will  be  established  to  link  the  CFD  with  realtime  simulations.  A 
building  bloek  approach  will  be  employed  to  first  demonstrate  non-realtime  integration  of  the 
CFD  simulation  framework  with  helicopter  flight  dynamic  models,  then  realtime  execution  for  a 
minimum  fidelity  airwake/aircraft  simulation,  then  build  to  higher  fidelity  realtime  simulations. 

1 . 1  Proj  ect  T echnical  Obj  ectives 

The  project  involves  the  following  seven  tasks  to  accomplish  the  technical  objectives  of 
the  project: 

Task  1:  Implement  modular  implicit/explicit  solver 

Task  2:  Apply  structured  numerics 

Task  3:  Apply  subdomain  with  immersed  boundary 

Task  4:  Implement  higher  order  explicit  solver  for  GPU  execution 

Task  5:  Integrate  with  the  GENHEF-PSU  flight  dynamics  model 

Task  6:  Demonstrate  flight  simulation  in  the  PSU  Rotorcraft  Simulation  Facility 

Task  7:  Demonstrate  flight  Simulation  in  NAVAIR  Manned  Flight  Simulator 
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2  WORK  SUMMARY 


During  this  reporting  period,  solver  development  was  performed  in  two  areas:  (1)  the 
incompressible  formulation  employed  by  the  CRUNCH  CFD  code  for  CFD  airwake  simulations 
was  implemented  in  the  structured  CRAFT  CFD  solver  (which  previously  only  included  a  fully 
compressible  formulation)  to  improve  the  structured  airwake  solutions,  and  (2)  an  approach  has 
been  developed  for  integrating  both  the  CRAFT  CFD  and  CRUNCH  CFD  solvers  within  a 
common  simulation  framework  (this  will  make  possible  combining  solver  speedups  from  tasks 
1  to  4  in  the  future). 

2,1  Incorporation  of  Preconditioned  Incompressible  Formulation  for  Structured  Solver 

Wake  calculations  needed  for  conducting  landing  simulations  on  naval  ships 
requires  flowfield  simulations  at  low  Mach  numbers.  CRUNCH  CFD  has  modeled  such 
simulations  using  an  incompressible  variant  of  the  preconditioning  formulation  to  the  Navier- 
Stokes  equations.  Specifically,  this  has  enabled  larger  time-stepping  and  improved  numerical 
stability,  particularly  in  regions  of  sharp  geometric  discontinuities.  The  incompressible 
formulation  was  incorporated  into  the  structured  CRAFT  CFD  flow  solver  based  on  these 
improved  numerical  stability  observations.  This  will  also  permit  better  flowfield  handshaking 
consistency  between  CRAFT  CFD  and  CRUNCH  CFD  for  dual  solver  operations,  explained  in 
the  next  section.  Unit  problem  checkout  studies  (simple  block  structured  LHA  airwake  grid. 
Figure  1)  using  CRAFT  CFD  have  indicated  time-steps  consistent  with  those  taken  by 
CRUNCH  CFD.  Additionally,  a  20%  runtime  acceleration  per  iteration  over  the  standard 
preconditioning  formulation  has  been  achieved. 


Figure  I:  Snapshot  of  example  LHA  airwake  solution  computed  by  CRAFT  CFD  with  the 

preconditioned  incompressible  formulation. 
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2,2  MPMD  Approach  for  integrating  Structured  and  Unstructured  Solver  Capabilities 

Fast-running  and  accurate  ship  wake  flowfield  computations  are  ehallenged  by  the  need 
for  very  large  eomputational  domain  meshes  and  need  to  resolve  deek  boundary  layer,  bluff 
body  regions,  and  impaet  of  superstrueture  geometry  on  flowfield  unsteadiness  in  regions  of 
aireraft  landing.  While  unstruetured  tetrahedral  meshes  are  ideal  for  effieiently  meshing 
eomplex  geometries,  sueh  as  ship  masts  and  antennae,  large  mesh  densities  are  needed  to  ensure 
good  eell  quality  and  minimize  grid  dissipation  due  to  grid  skewness.  Conversely,  hexahedral 
eells  are  best  suited  for  resolving  deek  surfaee  regions  and  boundary  layers.  Hexahedral  regions 
are  often  eonstrueted  using  struetured  mesh  generators.  Computational  overhead  and  implieit 
per-iteration  runtime  eosts  are  generally  significantly  less  for  struetured  solvers. 

Given  the  challenge  of  providing  ship  wake  unsteadiness  in  real-time  to  support 
pilot-in-the-loop  simulations  for  earner  landing  simulations,  there  is  a  need  to  combine  the 
eomputational  effieieney  of  structured  meshes  with  the  geometric  flexibility  of  unstructured 
meshes.  To  assist  in  meeting  this  objeetive  a  Multiple-Proeess  /  Multiple-Domain  (MPMD) 
approaeh  has  been  adopted  to  eombine  modeling  eapabilities  of  CRAFT  CFD  and  CRUNCH 
CFD  within  a  eommon  simulation  framework.  Speoifieally,  a  generalized  library  has  been 
developed  to  permit  data  transfers  at  speeified  boundaries  between  independently  running 
executables  of  these  two  flow  solvers.  Inter-eommunieators  within  the  MPI  library  are 
established  during  initialization  to  determine  whieh  proeessors  from  eaeh  solver  must  exehange 
data  with  the  eorresponding  solvers  on  the  adjaeent  domain  assigned  to  another  solver.  Onee 
speeialized  inter-solver  boundary  eonditions  are  written  within  eaeh  solver  for  handling  the  data 
transferred  from  another  solver,  a  generalized  MPI  runtime  library  establishes  a  message 
passing  link  between  the  two  solvers.  This  eliminates  the  need  for  one  solver  to  beeome 
essentially  a  dependent  subroutine  within  another  solver  and  so  maintains  eode  modeling 
flexibility  and  upgradability.  This  allows  the  ship  wake  runtime  requirements  and  ealeulations 
to  benefit  by  eombining  the  modeling  experienees  from  eaeh  solver  without  needing  to  perform 
extensive,  eostly,  and  error-prone  souree  eode  integration  prior  to  simulation.  At  present  this 
teehnique  will  be  demonstrated  using  CRUNCH  CFD  and  CRAFT  CFD,  but  this  approach  is 
sufficiently  generalized  to  permit  interfaeing  with  other  flow  solvers  and  interdiseiplinary 
models  as  well. 
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An  example  of  how  such  an  approach  could  be  utilized  is  shown  in  ,  where  the  nearfield 
structured  grid  surrounding  the  ship  (CRAFT  CFD  solver)  communicates  with  an  unstructured 
farfield  domain  (CRUNCH  CFD  solver)  via  the  inter-solver  boundary  condition  highlighted 
with  the  red  dashed  line.  Such  an  approach  will  be  important  later  in  the  program  when  solver 
improvements  targeting  both  the  structured  and  unstructured  solvers  can  be  integrated  to  a 
single  simulation  framework. 


Figure  2:  Schematic  of  MPMD  approach. 


3  TECHNICAL/COST  STATUS  AND  PROBLEM  AREAS 

No  technical  or  financial  problems  have  been  encountered. 

4  MEETING  AND/OR  TRAVEL 

N/A 

5  CONTRACT  SCHEDULE 

The  program  is  proceeding  as  planned. 

6  PLANNED  ACTIVITIES  FOR  NEXT  REPORTING  PERIOD 

During  the  next  reporting  period  a  structured  multi-block  grid  for  the  LHD  ship 
geometry  will  be  obtained  and  comparison  simulations  will  be  initiated  to  complete  a 
verification  of  the  structured  solver  improvements  and  applicability  of  the  structured  numeric  to 
airwake  simulations. 
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